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Abstract: Detecting and identifying weak gaseous plumes using thermal imaging data is com- 
plicated by many factors. There are several methods currently being used to detect plumes. 
They can be grouped into two categories: those that use a chemical spectral library and those 
that don't. The approaches that use chemical libraries include physics-based least squares 
methods (matched filter). They are "optimal" only if the plume chemical is actually in the 
search library but risk missing chemicals not in the library. The methods that don't use a 
chemical spectral library are based on a statistical or data analytical transformation applied 
to the data. These include principle components, independent components, entropy, Fourier 
transform, and others. These methods do not explicitly take advantage of the physics of the 
signal formulation process and therefore don't exploit all available information in the data. 
This paper describes generalized least squares detection using gas spectra, presents a new de- 
tection method using basis vectors, and compares detection images resulting from applying 
both methods to synthetic hyperspectral data. 

Keywords: Plumes; detection; LWIR; basis vectors; generalized least squares. 



1. Introduction 

Detecting and identifying weak gaseous plumes using infrared measurement instruments is a chal- 
lenge that receives continual attention. Burr and Hengartner [1] have provided a comprehensive review 
of this problem. There are several methods currently being used to detect plumes. They can be grouped 
into two categories, those that use chemical libraries and those that don't. 
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The approaches that use chemical libraries include least squares approaches (i.e., the use of matched 
filters) and other physics-based methods [1-3]. These methods search for evidence of a specific chemical 
signature in an image by using a library of laboratory measured chemical spectra. A "detection image" 
is created for each chemical by applying some variation of a matched filter to each pixel in the image [1]. 
An analyst then looks for "plume-like" shapes in each detection image. Shortcomings of these methods 
include the following. They are "optimal" only if the plume chemical is actually in the search library but 
risk missing chemicals not in the library. Also, due to the uncertainties in the environmental parameters, 
they risk not detecting plumes that are distorted by atmospheric and other environmental uncertainties. 
These approaches have the ability to simultaneously detect the plume and potentially identify the plume's 
chemical constituents, which is a key difference between them and the methods we describe next which 
only detect plumes. 

Methods that don't use a chemical spectral library are based on a statistical or data analytical trans- 
formation applied to the data. These include principle components, independent components, entropy, 
Fourier transform, and several other combinations or modifications, e.g. see [4]. These methods do 
not explicitly take advantage of the signal formulation physics, and therefore don't exploit all available 
information in the data. They also risk producing features/artifacts that have no obvious physics-based 
interpretation. Finally, they also rely on an analyst to recognize "plume-like" objects and distinguish 
them from non-plume features. 

In this paper we introduce a plume detection method that avoids some short-comings of both previ- 
ously mentioned methods but also has features in common with both. This new method is not intended 
to replace current methods but rather to complement them. It is physics-based but it is not defined by 
the members of any specific collection of chemicals, large or small. Instead it uses surrogate chemical 
spectra which form a basis set for the set of all possible chemical spectra. The method has been applied 
to both real and synthetic hyperspectral imagery. Only the results from synthetic data are presented 
here but results on real datacubes are similar. Section 2 presents the physics-based model. Section 3 
presents matched filter detection and the basis vector method. Section 4 presents experimental results on 
a synthetic HSI datacube and conclusions are presented in Section 5. 

2. Physics-based Radiance Model 

In this section we present the three-layer physics-based radiance model which describes the basic 
physics of radiative transfer in the context of plume detection [1, 3, 5]. We present the model as a 
function of wavelength, A (in /im). 

This model can be written as: 

Lobs{>^) = ra(A)[(l - T.^{\))B{Tp- A) + rp(A)L,(A)] + L„(A) + n(A) (1) 

where Lobs{^) represents sensor-recorded radiance in W/{m? * sr * /im) at wavelength A (/im), Ta{X) 
and Tp{\) are dimensionless terms representing the atmosphere and plume transmissivity, respectively, 
B{Tp] A) has radiance units and is Planck's Blackbody function at wavelength A and plume temperature 
Tp (K), Lg{X) and Lu{\) are the ground- leaving and atmospheric upwelling radiances, respectively, and 
n(A) includes unmodeled effects and sensor noise [6]. 
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Following the convention of [1, 7], we model the ground-leaving radiance as: 

Lg{\) = e,{X)B{T,-\) (2) 

where eg(A) is a dimensionless quantity representing the emissivity of the ground at wavelength A, with 
0 < fg(^) ^ 1» ^iid represents the ground temperature. Note that this formulation ignores the 
reflected atmospheric downwelling radiance. This assumption is reasonable in the Longwave Infrared 
band (LWIR) because the reflected radiance contribution to observed signal is negligible [7]. 

The Beer-Bourger-Lambert Law [8] gives an explicit expression for the transmissivity of a plume in 
terms of the chemical effluent's concentration path-length, c (with c measured in parts-per-million-meter, 
denoted ppm-m), as follows: 

. Nc X 

Tp = expi-'^Aj{\)cj\ (3) 
V j=i J 

where Aj{X) is the absorbance coefficient of chemical j in {ppm-m)^^ [8] and N^. denotes the number of 
chemicals in the plume. For optically thin plumes, this term is well approximated by the first two terms 
in a Taylor Series expansion [1]. This gives: 

Nc 

r,(A)-l-^A,(A)c, (4) 
i=i 

for small c. 

Substituting Equation (4) into Equation (1) yields the working gas-plume linearized model: 

Nc 

LobsW = ra{\)[B{Tp, A) - L,(A)] "^jW^i + ^^aWLgiX) + L„(A) + n(A) (5) 

i=i 

where the noise term n(\) now includes the approximation error due to application of Equation (4). 
Equation (5) shows that the sensor incident radiance Lobsi^) can be represented as an additive layering 
of the chemical signal Ta{X)[B(Tp] A) — Lg{X)] J2f=i ^jW^j^ ground radiance transmitted through the 
atmosphere, ra{\)Lg(\), atmospheric upwelling radiance, L„(A), and noise, n(A). This formulation 
motivates scene whitening i.e. background radiance subtraction and decorrelation. In the next section 
we discuss scene whitening in the context of the detection methods. 

3. Detection Method Formulations 

In this section we discuss the matched filter or generalized least squares (GLS) approach to gas de- 
tection and the Basis Vector Detection (BVD) method. 

3.1. Matched Filter 

As a hyperspectral sensing instrument records radiance at a number of channels, we will present the 
physics-based model and data processing in vector-matrix notation. We will also restrict our exploration 
to the single chemical case. 

Let Nx denote the number of spectral channels recorded by the instrument. The physics-based model 
in Equation (5) can be written in vector form as: 
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Lohs = TaQ {B{Tp) - Lg)Q Ac + Ta(DLg + Lu + n (6) 

where bold terms represent A^a x 1 vectors and 0 denotes the Hadamard product (element-wise muki- 
plication). 

An initial step is to remove the background radiance. To do this we compute the scene-wide mean 
radiance L = TaQ Lg + Lu + n while assuming constant atmospheric terms Tq and Lu- This provides a 
reasonable approximation to the background (non-plume) radiance provided the plume(s) are small (up 
to a few tens of pixels out of tens of thousands) and weak (in concentration and temperature contrast 
with the background) [1]. We subtract L from both sides of Equation (6) to arrive at: 

r = Lobs - L 

= TaQ{B{Tp)-Lg)&Ac + z (7) 

where r is the mean subtracted pixel radiance and we assume z = 0 (Lg — Lg) + (n — n) is zero 
mean with covariance matrix S. Under the weak gaseous plume assumption, the scene- wide covariance 
S will provide a reasonable approximation to S [1]. 

Equation (7) motivates the GLS approach to gas detection. However, the most appropriate treatment 
requires knowledge of the nuisance parameters r^, Tp and Lg. The atmospheric transmissivity can 
be estimated using an in scene method such as ISAC [9] or can be modeled using radiosonde data and 
estimated by MODTRAN [10]. There are several methods that can provide in scene estimates of Lg or 
attempt to retrieve surface emissivity and temperature [5, 11]. 

For this paper we take the worst case approach which is to assume no information about the nuisance 
parameters is available. If such information is available, it can be incorporated to improve performance. 
We consider finding the GLS solution (3 to: 

r = Ap + z (8) 

and consider large values of (3 as evidence of chemical signature due to A in the pixel [1]. Explicitly we 
will compute: 

f3 = {A'±-^A)-^A'±-^r. (9) 

In summary, for each chemical in the library of candidates, a detection image is constructed from the 
results of computing (3 on each pixel. The "/3-image" is then inspected for groups of contiguous pixels 
with large (3 values, perhaps showing a "plume-like" shape. 

The success of this method depends on having the plume chemicals in the search library. If the plume 
chemicals are not known, choosing the chemical search library can be a challenge. Due to these factors, 
we developed a plume detection method independent of the chemicals in the plume but still using the 
physics-based model, which we present in the next subsection. 

3.2. Basis Vector Detection (BVD) 

BVD is based on a fixed set of surrogate chemical spectra that are defined by the resolution of the 
imaging instrument and not by the chemical library. We choose the set of surrogate spectra to span 
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the vector space M^, the set of all possible spectra produced by a hyperspectral instrument with N\ 
channels. There are several ways to construct a basis for this space. For this work we explore the 
coordinate unit vectors, which is the simplest basis in the sense that it is both orthogonal and sparse. We 
intend to explore the application of other basis sets in future work. 

Suppose the hyperspectral instrument collects energy at a set of wavelengths A = { Ai , A2 , . . . , A^V;, } in 
theLWIR. Then the surrogate set of spectra is E = {ei, 62, . . . , cat^}, where = (0, . . . , 0, 1, 0, . . . , 0)' 
has dimension Nx with the 1 in position k. Each basis vector is used to search for large deviations in its 
respective direction and these may be associated with the effects of a chemical effluent. One immediate 
advantage of this approach is that the size of the surrogate library E is fixed and can be used to detect 
every chemical or combination of chemicals in any chemical library, no matter how large. 

The goal of BVD is to produce a detection image for each channel k which will be inspected for 
"plume-like" shapes. To do this we will consider how well the basis vector fits the whitened pixel 
r = Lobs — Lhy finding the GLS solution to: 

r = BkPk + z. (10) 

Thus we compute: 

^k = {ei±-'ek)-'e',±-'r (11) 

for each channel k. We consider large values of jJk as evidence of the effects of a chemical effluent. 
This analysis is applied to every pixel producing a "/S^-image" for each channel A^. This set of detection 
images is scanned by an analyst to find "plume-like" shapes. 

3.3. BVD Justification 

In this section we analyze the relationship between Pk in Equation (11) and the chemical absorbance 
spectra. With some simplifying assumptions, we show that, when the plume is composed of one chemi- 
cal, Pk is proportional to the magnitude of the chemical absorbance in channel k. In experimentation we 
observe that the detection images for channels in which a chemical exhibits large absorbance features 
sometimes contain strong evidence for plume detection, i.e. we observe large (3^ when chemical A has a 
large absorbance value in channel k. We show that Pk is proportional to Ak if we ignore sensor noise. 
This simplification is reasonable in this case because our goal is to isolate the relationship between (3k 
and Ak. 

We recall our assumption of only one chemical in the plume and since Lg = egQB(Tg), we substitute 
this into Equation (7) to get: 

r = TaQ {B{Tp) -SgQ B{Tg)) QAc + z. (12) 
We substitute Equation (12) into Equation (11) and set c = 1 to get: 

- J-^e',±-'TaQ{BiT,)-egQBiTg))A. (13) 

^kk 

Ignoring sensor noise it is possible to express the covariance matrix S as a function of the nuisance 
parameters Tq, Tg, and Sg as follows: 

S = [r, 0 B{Tg)]Varieg)[B{Tg) 0 rj (14) 
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where [■] denotes rearranging an ?i-vector into an x diagonal matrix. Thus we can re-express Equation 
(13) as: 

4 = ^el[rJ-i[B(Tj]-Var(e,)-i[B(T,)]-MTj-MrJ[S(T,) -e,0S(r,)]A 



]-\B{T,)]-^Var{e,)-\[B{T,)][B{T,)]-^ - [e,])A 



If we assume the diagonals of Var{eg)^^ are large compared to the off-diagonals, then Equation (15) 
simplifies to: 

4 = Ta, {B{Xp)k - B{Tg)k) Ak . (16) 

This shows that pk is proportional to Ak and also depends on the temperature-emissivity contrast 
and atmospheric transmissivity as expected. Thus, channels where A has large absorbance features will 
produce detection images with strong plume pixels relative to channels where A has small absorbance 
features. The plume will show up in a channel because pixels that contain the plume should yield larger 
values of (3k relative to pixels that do not contain the plume (barring the effects of large deviations due 
to the background mean subtraction). 

We note that for chemicals with sharp features in a few channels. Equation (15) says that only those 
channels may show the plume. For chemicals with large broad features (features spread over many 
channels). Equation (15) says that we may observe the plume in many of those channels. Equation (15) 
also shows that even if chemical A has a large absorbance in channel k, the atmosphere could obscure 
the plume signal and produce a small Pk- Similarly Equation (15) shows that if e^^^ = B{Tp)k/ B{Tg)k 
then jSk may be small. Note, this can only happen if Tp <Tg. 

4. Experimental Results 

We present results on synthetic hyperspectral imagery created with the Digitial Imaging and Remote 
Sensing Image Generator (DIRSIG) model developed at Rochester Institute of Technology (RIT). Please 
see [2, 7] for a detailed description of the image. We first present and discuss the synthetic image. 
Second we present plume detection results from applying the Matched Filter and BVD approaches. 

4.1. Synthetic Imagery 

The DIRSIG image represents a highly cluttered urban scene. The image has 200 x 200 spatial pixels 
with 128 LWIR channels ranging from 7.5188 fim to 13.605 /im. This image includes two large simulated 
plume releases, one each for gases Freon-114 and ammonia (NH3). A wideband picture of the DIRSIG 
image and the plume mask are presented in Figure 1(a) and (b) respectively. The plume temperature and 
concentration path-lengths are strongest near the release point. The plume concentration path-lengths 
vary from approximately 70 ppm-m at the source to approximately 1 ppm-m at the lower right edge of 
the image. Figure 1(b) shows that the plumes cover a considerable region of the synthetic scene. We 
note that the two large plumes cover approximately 23% of the image. 
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Figure 1. Images that show (a) a wideband picture of the synthetic DIRSIG image and (b) a 
mask image of the gaussian shaped NH3 (lower left) and Freon (upper right) plumes. 




(a) (b) 

4.2. Scene Whitening 

It is well known that large amounts of plume information in the whitening statistics L and S will de- 
grade the performance of matched filter detection [12]. This may be difficult to avoid in practice because 
eliminating plume information from the whitening statistics requires knowledge of which pixels are 
plume pixels. If this information is available a priori then detection is not necessary. To produce an in- 
formative comparison between matched filter detection and BVD, we compare them under two whitening 
approaches, scene-wide whitening and background-only whitening (no plume pixels). Background-only 
whitening is possible on our synthetic DIRSIG image because we have ground truth which allows us to 
remove every plume pixel from the whitening statistics. In practice, whitening usually occurs somewhere 
between these two extremes. 

4. 3. Matched Filter Detection Images 

We applied the matched filter detection method as described in Section 3.1 using both Freon and NH3 
gas absorbance spectra from the PNNL Vapor Phase Library [13]. A detection image was created for 
each chemical using both scene-wide and background-only whitening. These are presented in Figure 3. 
To aid interpretation of the results, we include the absorbance spectra for both Freon- 114 and NH3 in 
Figure 2, along with notation to indicate the channels displayed later in the BVD results. 

Figure 3(a) displays the detection image for Freon using scene-wide whitening. The image shows 
some groupings of pixels in the region of the Freon plume that exhibit visual contrast to the surrounding 
pixels. We consider these pixels as the matched filter evidence for the Freon plume. 

Figure 3(b) displays the detection image for NH3 using scene-wide whitening. The image shows 
a grouping of pixels near the release point that have a bright contrast to the surrounding pixels. We 
consider these pixels as the matched filter evidence for the NH3 plume. 
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Figure 2. Chemical absorbance spectra for Freon-114 and NH 3. 



Chemical Absorbance 




0 20 40 60 80 100 120 

channel 



Figure 3(c) displays the detection image for Freon using background-only scene whitening. As ex- 
pected, this detection image is much improved over Figure 3(a). When compared to the plume mask in 
1(b) we see that even pixels at significant distance from the source stand out from the background. 

Figure 3(d) displays the detection image for NH3 using background-only whitening. In this case we 
also see significant improvement over Figure 3(b) but due to the similar spectral features near channel 
35 and 58 in both Freon and NH3, the Freon plume is just as visually prominent as the NH3 plume in 
the NH3 detection image. This may be an advantage in that the NH3 image reveals both the NH3 and the 
Freon plume, but may be misleading in the identification phase. These images will be compared to BVD 
detection images which we present in the next section. 

4.4. BVD Detection Images 

We applied BVD as described in Section 3.2 to the DIRSIG image. This resulted in a set of 128 
images that were inspected for gray scale contrast in the region of either plume. There were multiple 
images that showed some contrast. We present two for each chemical plume that provide detection 
evidence. 

Figure 4(a), (b) shows gray scale contrast in the region of the Freon plume using scene- wide whitening. 
These are channels 15 and 35. The image in Figure 4(a) is similar to the matched filter Freon image in 
Figure 3(a). Figure 4(b) shows similar patterns but with an opposite color contrast to Figure 3(a) and 
Figure 4(a). Figure 4(c), (d) shows gray scale contrast in the region of the NH3 plume using scene-wide 
whitening. These are channels 37 and 58. When compared to the matched filter NH3 image in Figure 
3(b) they show arguably better gray scale contrast in the region of the NH3 plume. Specifically Figure 
4(d) shows a brighter collection of pixels in the region of the NH3 plume than does the matched filter 
NH3 image in Figure 3(b). 
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Figure 3. Images that show the GLS detection image for (a) Freon (scene-wide whiten- 
ing), (b) NH3 (scene- wide whitening), (c) Freon (background-only whitening) and (d) NH3 
(background-only whitening). 




(c) (d) 

Figure 4 (e) shows gray scale contrast in the region of the Freon plume due to channel 35 using 
background-only whitening. It is a significant improvement over the scene-wide whitening results in 
Figure 4 (a) and (b), and it is almost identical to the background-only matched filter result for Freon 
in Figure 3(c). Figure 4(f) shows gray scale contrast in the region of the NH3 plume due to channel 
52. It shows some improvement over the scene-wide result in Figure 4(c) and (d); and it is similar to the 
background-only matched filter result for NH3 in Figure 3(d), except it contains only very weak evidence 
of the Freon plume. 
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Figure 4. Images that show the BVD image detecting the (a) Freon plume in Channel 15 
(scene-wide whitening) (b) Freon plume in Channel 35 (scene-wide whitening) (c) NH3 
plume in Channel 37 (scene-wide whitening) (d) NH3 plume in Channel 58 (scene-wide 
whitening) (e) Freon plume in channel 35 (background-only whitening) and (f) NH3 plume 
in channel 52 (background-only whitening). 




(e) (f) 
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5. Conclusions 

The purpose of this paper is to introduce the BVD method and compare it to other plume detection 
methods, in particular, matched filter methods based on GLS. We have shown it has potential to be part 
of a robust atmospheric chemical plume detection tool. How BVD fits into such a tool remains to be 
determined. 

The BVD method does not require a chemical search library and yet it appears to detect plumes as 
well as the matched filter method which does depend on a chemical search library. Further study is 
needed in a weak plume environment. In this study, we attempted to make the comparison meaningful 
by looking at two cases: scene-wide and background-only whitening statistics. These cases were chosen 
because they represent the extreme performance expectations for matched filter detection. Scene-wide 
whitening is known to be the worst case for matched filter detection while background-only whitening 
is known to be optimal. In both cases, BVD produces visual detection images that are comparable to the 
matched filter detection images. 

Since BVD is based on a surrogate set of spectra that span the set of all possible spectra, it is guaran- 
teed to respond to any chemical plume without prior knowledge of the plume constituents. Detectability 
depends on plume strength, just as it does for every other detection method. While BVD is a plume 
detection method, it provides some information about the spectral content of the plume signal, which 
could be used as a precursor to chemical identification. 

The basic BVD method presented here suggests several extensions and adaptations. The figures 
show selected detection images based on the (3 images but initial results have shown that Bayesian 
methods can help sharpen detection image contrast. The BVD /3 images shown here are the channels 
that best represent the plume but several other channels exhibit some plume evidence. Bayesian methods 
combined with BVD provide a way to improve contrast in the best channels by taking advantage of 
the weak evidence in other channels. They also tend to concentrate plume information into a smaller 
number of channels, making visual inspection of all channels easier for the analyst. In addition, Bayesian 
methods may lead to more automated detection methods, reducing the need for an analyst to inspect 
every detection image. We are considering other post-processing of the $ data to sharpen contrast and 
automate detection. 

The basis set used here is the coordinate unit vectors. There are several other possible basis sets 
that could be used depending on the a priori information available. For example, suppose the user is 
interested in a small set of chemicals, but wants to make sure that other chemicals are not missed. The 
basis set could be adapted to include the small target set, and augmented with additional vectors using 
the Gram-Schmidt process so the whole vector space is represented. This would be a hybrid approach 
combining traditional matched filter detection with the BVD method presented in this paper. 

In addition, we are working on other ideas related to BVD. These include using the BVD results to 
construct a prior distribution on the model space to improve plume identification, and using combinations 
of basis vectors in BVD instead of single channels. 
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